Baby steps towards few-shot learning with multiple semantics
نویسندگان
چکیده
Learning from one or few visual examples is of the key capabilities humans since early infancy, but still a significant challenge for modern AI systems. While considerable progress has been achieved in few-shot learning image examples, much less attention given to verbal descriptions that are usually provided infants when they presented with new object. In this paper, we focus on role additional semantics can significantly facilitate learning. Building upon recent advances semantic information, demonstrate further improvements possible by combining multiple and richer (category labels, attributes, natural language descriptions). Using these ideas, offer community results popular miniImageNet CUB benchmarks, comparing favorably previous state-of-the-art both only plus semantics-based approaches. We also performed an ablation study investigating components design choices our approach. Code available github.com/EliSchwartz/mutiple-semantics.
منابع مشابه
Few-shot Learning
Though deep neural networks have shown great success in the large data domain, they generally perform poorly on few-shot learning tasks, where a classifier has to quickly generalize after seeing very few examples from each class. The general belief is that gradient-based optimization in high capacity classifiers requires many iterative steps over many examples to perform well. Here, we propose ...
متن کاملFew-shot Autoregressive Density Estimation: Towards Learning to Learn Distributions
Deep autoregressive models have shown state-of-the-art performance in density estimation for natural images on large-scale datasets such as ImageNet. However, such models require many thousands of gradient-based weight updates and unique image examples for training. Ideally, the models would rapidly learn visual concepts from only a handful of examples, similar to the manner in which humans lea...
متن کاملFew-shot Autoregressive Density Estimation: towards Learning to Learn Distributions
Deep autoregressive models have shown state-of-the-art performance in density estimation for natural images on large-scale datasets such as ImageNet. However, such models require many thousands of gradient-based weight updates and unique image examples for training. Ideally, the models would rapidly learn visual concepts from only a handful of examples, similar to the manner in which humans lea...
متن کاملFew-Shot Learning with Graph Neural Networks
We propose to study the problem of few-shot learning with the prism of inference on a partially observed graphical model, constructed from a collection of input images whose label can be either observed or not. By assimilating generic message-passing inference algorithms with their neural-network counterparts, we define a graph neural network architecture that generalizes several of the recentl...
متن کاملFew-Shot Learning with Meta Metric Learners
Existing few-shot learning approaches are based on either meta-learning or metriclearning, which would suffer if the tasks have varying numbers of classes and/or the tasks diverge significantly. We propose meta metric learning to deal with the limitations of the existing few-shot learning approaches. Our meta metric learning approach consists of two components, task-specific learners that explo...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Pattern Recognition Letters
سال: 2022
ISSN: ['1872-7344', '0167-8655']
DOI: https://doi.org/10.1016/j.patrec.2022.06.012